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Classical measures of smoothness 

The following is a short introduction to Besov spaces and their 
characterization by means of approximation procedures as well as wavelet 
decompositions. 


There exist many different ways of measuring the smoothness of a function 
f. The most natural one is certainly the order of differentiability, i.e. the 
maximal index m such that f(™ = (2)" f is continuous. To this 
particular measure of smoothness, we can associate a class of function 
spaces: if J is an interval of IR, we denote by @™ (I) the space of 
continuous functions which have bounded and continuous derivatives, up to 
the order m. This space can be equipped with the norm 

Equation: 


| f llemcry ee sup FO (x). 
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for which it is a Banach space. (That is, the space is a vector space; the 
norm satisfies the triangle inequality; || f ||= 0 is possible only if f = 0; 
finally, all Cauchy sequences converge: if we have a sequence with entries 
fn © @™ (L) for which || fp — fn’ || can be made arbitrarily small simply 
by choosing n,n’ sufficiently large, then the f, (and all their derivatives up 
to the mth) converge uniformly to some function f in @”™ (and its 
derivatives). 


In the case of a multivariate domain 2 € R%, we define ¢™ (2) to be the 


space of continuous functions which have bounded and continuous partial 
alelf 


derivatives 0° f := —a,——~z, for Ja] := ay +--+ +ag=0,---,m. 
due). -Ax5 
This space can also be equipped with the norm 


Equation: 


|| f ema) = > ia |O° Ff (x)I, 
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for which it is a Banach space. 


In many instances, one is somehow interested in measuring smoothness in 
an average sense: for this purpose it is natural to introduce the Sobolev 
spacesW”” (2) consisting of all functions f € L? with partial derivatives 
up to order m in L”. Here p is a fixed index in [1, +-co]. (Recall that 


Be 
| f lle = Wo lf @)P] ® ifp < +00 and || f ||. =supzeg | f (z)|.) This 
space is also a Banach space, when equipped with the norm 
Equation: 
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Note that the norm for @™ spaces coincides with the W™*° norm. 


Towards fractional smoothness 

The following is a short introduction to Besov spaces and their 
characterization by means of approximation procedures as well as wavelet 
decompositions. 


All the above spaces share the common feature that the regularity index is 
an integer. In many applications, one is interested to allow fractional order 
of smoothness, in order to describe the regularity of a function in a more 
precise way. The question thus arises of how to fill the gaps between 
integer smoothness classes. There are at least two instances where such a 
generalization is very natural: 


¢ In the case of L?-Sobolev spaces H™ := W™? and when 2 = R4, 
we can define an equivalent norm based on the Fourier transform, 
since by Parseval's formula we have the norm equivalence 
Equation: 


ll f Wlgm ~ dh (1+ jal)?" |Fw)| de. 


For anon-integer s > 0, it is thus natural to define the space H° as the 
set of all LZ? functions such that 
Equation: 


I Fle = f+ bo)” | Fe) ae 


is finite. 

e Inthe case of @™ spaces, we note that 
supe |f (xz) — f(a —h)| < Clhl if f ¢ @? for any h € R? 
whereas for an arbitrary function f € @°, 
supzea |f (x) — f (a — h)| might go to zero arbitrarily slow as 
|| — 0. This motivates the definition of the Hélder space@ ’*, 
0 < s < 1 consisting of those f € @° such that 
Equation: 


sup |f (x) — f(@—h)| < Clhl’. 
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Ifm <s <m-+1z,a natural definition of @* is given by f Ee &™ 
and 0° f € @*°-™, |a| = m. It can be proved that this property can 
also be expressed by 

Equation: 


sup |Aj, f (x)| < ClAl’, 
rE 


where n > s and A? is the n-th order finite difference operator 
defined recursively by A; f (a) = f (x) — f (x — h) and 

Alt (aS AF [Ay (x) (for example 

A? f (x) = f (x) — 2f (a — h) + f (x — 2h)). When s is not an 
integer, the spaces @ * that we have defined are also denoted as W *. 
The space @’ can be equiped with the norm 

Equation: 


Il F lles(ay = Il F lzoayt+ sup [All] AnF lla): 
heR¢4 


Let us give two important instances in which the above spaces appear in a 
natural way. The first is the study of the restriction of a function 
f(#1,°-+, 2a) to a manifold of lower dimension, for example the 
hyperplane defined by xq = 0. If g(1,---,%a-1) = f (@1,---, La-1, 0) 
is such a restriction, then it is known that f € H* (R4 for s > 4 implies 
that g © H 8-7 Re"), The second one is the study of the Brownian 
motion W(t) on an interval I, for which it is known that W(t) is almost 


surely in Cz~ foralle > 0. 


Besov spaces 

The following is a short introduction to Besov spaces and their 
characterization by means of approximation procedures as well as wavelet 
decompositions. 


The definition of “order of smoothness s in LD?” for s non-integer and p 
different from 2 or co is more subject to arbitrary choices. Among others, one 
may consider: 


e Sobolev spaces W *” defined (if m < s <m-+ 1) by 
Equation: 


_ sak Old 
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These spaces coincide with those defined by means of Fourier transform 
when p = 2 (see [link] for a general treatment). 

¢ Bessel-potential spaces H *? defined by means of the Fourier transform 
operator F, 
Equation: 


IF lle = (Ft FOO FE IE) 


These spaces coincides with the Sobolev spaces W”™-? when m is an 
integer and 1 < p < +00 (see [link], p.38), but their definition requires 
that 2 = R® in order to apply the Fourier transform. 

e Besov spaces D,, q iivolving an extra parameter q that we define below 
through finite differences. These spaces include most of those that we 
have listed so far as particular cases. As we shall see, one of their main 
interest is that they can be exactly characterized by multiresolution 
approximation error, as well as from the size properties of the wavelet 
coefficients. 


We define the n-th order L? modulus of smoothness of f by 
Equation: 


wats, Lee =sup | Anf I °(Qnn)? 
|A|<t 


where nn := {2 € 2; «—kh © 2, k=0,---,n}. Here we measure the 
“size” of A? f in L?-norm, where we restrict to L? (2p,,) to ensure that all 
the arguments x — kh occurring in the computation of A’ f (a) still live in Q 
. For p,q > 1, s > 0, the Besov spaces Be q consists of those functions 

f € LP such that 

Equation: 


(2"0(F.2°9) a9) jog € A 


Here n is an integer strictly larger than s. A natural norm for such a space is 
then given by 
Equation: 


ll f | 
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If g = o«, the condition [link] simply means that || A? f ||» < Ch ° for 

|h| < 1. For q < oo, the decay condition on A? f is slightly stronger, since 
we require that the sequence (22 Oy ( f,279 ) - er be summable. The space 
B,, P also represents “s order of smoothness measured in L?"; the parameter q 
allows a finer tuning on the degree of smoothness - one has Bh, C By. ,, if 
@Q1 < qe - but plays a minor role in comparison to s since clearly 

Equation: 


B®? Cc B®? 


P,Q P,q2? if $1 a $2) 


regardless of the values of q; and gz. Roughly speaking, smoothness of order 
s in L” is expressed here by the fact that, for n large enough, wn(f,t) ;» goes 
to 0 like @(t*) ast > 0. 


Clearly @* = By .,00 When s is not an integer. It can also be proved that when 
s is not an integer W*? = By. These spaces are different from one another 
for integer values of s, except when p = 2 in which case H* = B}, for all 
values of s (see [link], p.38). 


Embeddings 

The following is a short introduction to Besov spaces and their 
characterization by means of approximation procedures as well as wavelet 
decompositions. 


Sobolev, Besov and Bessel-potential spaces satisfy two obvious embedding 
relations: 


e For fixed p (and arbitrary q in the case of Besov spaces), the spaces get 
larger as s decreases. 

e In the case where {2 a bounded domain, for fixed s (and fixed q in the 
case of Besov spaces), the spaces get larger as p decrease, since 


| f Il ee: = C'|| f ll ze. if p) < po. 


A less trivial type of embedding is known as Sobolev embedding. In the 
case of Sobolev spaces, it states that the continuous embedding 
Equation: 


WshP1 Cc W52P2 if pi < pa and s;—s2> d(1/p1 — 1/p2), 


holds except in the case where pp = +00 and 89 is an integer, for which 
one needs to assume $1 — $2 > d(1/p; — 1/p2). For example in the 
univariate case, any H'! function has also  '/? smoothness. In the case of 
Besov spaces the embedding relation are given by 


Equation: 
Bri, © Bop, if pi <p2 and s1— 82 > d(1/pi — 1/p2), 


with no other restrictions on the indices s,s. > 0. In the case where J is a 
bounded domain, these embedding are compact if and only if the strict 
inequality s; — s2 > d(1/p1 — 1/pe2) holds. The proof of these 
embeddings can be found in [link] for Sobolev spaces and [link] for Besov 
spaces. 


As an exercise, let us see how these embeddings can be used to derive the 
range of r such that Bg , ((0, 1]) can contain discontinuous functions. If 


r > 1/2, then there exists ¢ > 0 such that r — 2e > 1/2; We remark that 
3¢ — Bag © Bao = @*, 80 all functions in Bj , are continuous. 


Therefore only By , with r < 1 /2 can contain discontinuous functions. In 


the limiting case r = 1/2, a closer inspection reveals that the functions in 
72 


1/2 ; : . . : . 
B / are continuous if g < oo, while B,'>. includes discontinuous 


2,9 
functions, such as the characteristic funciton of an interval [0, a] for 
0 <ac< 1; 


Characterization by approximation properties 

The following is a short introduction to Besov spaces and their 
characterization by means of approximation procedures as well as wavelet 
decompositions. 


An important feature of Besov spaces is that they admit equivalent 
characterization by multiresolution approximation properties and by 
wavelet decompositions. 


Here we use the following standard notation (see [link] or [link] for a 
general treatment): if f is function we denote by P;f its projection onto the 
space V;, and by Q;f = P;41f — P;f its projection onto the detail space 
W;;. The multiscale decomposition of f writes 

Equation: 


f=Pof+ >  Q;f. 
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The projectors P; and @, can be further expressed in terms of biorthogonal 
scaling functions and wavelets bases: 
Equation: 


PLP = 1 (fda)da and Qif = D> (fda)vx 


|A|=J |A|=J 


Here we use the simplified notation ¢, with “|A| = 7” meaning that the 
functions are picked at resolution 7. In the case where 2 = R4, these have 
the general from $) (a) := $j, (x) := 2%/? (24a — k), bur for a general 
domain 2 = R? proper adaptations of these bases need to be done near the 
boundary. We can therefore write 

Equation: 


f= Sod, d= (fda), 


where we include in this sum the wavelets at all levels 7 > 0 and we 
incorporate the scaling function @) at the first level |A| = 0. 


Under certain assumptions that we shall discuss below, it is known that the 
Besov norm || f ||,,, is equivalent to 
Pq 


Equation: 

| Pof Inet Il (2° || F-Pif Ize) 20 lee 
or to 
Equation: 


| Pof Inet I (27 |] Qif Ize) s20 Meo 


Using the equivalence || Q;f Ile ~ 24-44] (dy) yy-5 Il, 


to prove a third equivalent norm in terms of the wavelet coefficients: 
Equation: 


at each level 


|| (297 264/2-4/)9 || (dy) y_5 Mle 520 Mee: 


These equivalences mean that the modulus of smoothness w,, ( f,27 ) pp in 
the definition of By, can be replaced either by || f—P;f ||,» or by 
|| Q;f ||,» Their validity requires that the spaces V; satisfy the following 


two assumptions: 


e The V; must satisfy an approximation property that takes the form of a 
direct estimate 
Equation: 


| F—Pif In» S Cun(f,2°7) 1. 


Such an estimate ensures that a smooth function will have a fast rate of 
approximation. 


e They must also satisfy smoothness properties that takes the form of an 
inverse estimate 
Equation: 


Wn(fj,t) pe = C[min (1, 42’) ]"|| fj l ee if fj S Vj. 


Such an estimate takes into account the smoothness of the spaces V;;: it 
ensures that a function that is approximated at a sufficiently fast rate 
rate by these spaces should also have some smoothness. 


One can show that the direct estimate is satisfied if and only if all 
polynomials up to order n — 1 can be written as combinations of the scaling 
functions @) in V;, or equivalently if the dual wavelets wy have n 
vanishing moments. On the other hand, the inverse estimate requires that 
the scaling functions @) that generates V; are smooth in the sense of 
belonging to W™”. Note that the direct estimate immediately implies that 
the expression [link] is less than || f || Bs A more refined mechanism, 
using the inverse estimate (as well as some discrete Hardy inequalities) is 
used to prove the full equivalence between || f || g;_ and [link] or [link]. We 


refer to chapter III in [link] for a detailed proof of these results. 


These equivalences show that the convergence rate N~*/¢ (N = dim(V;)) 
can be achieved by the linear multiscale approximation process f ++ Py, if 
and only if the function has roughly “¢ derivatives in L?”. 


Besov spaces and nonlinear approximation 

The following is a short introduction to Besov spaces and their 
characterization by means of approximation procedures as well as wavelet 
decompositions. 


A natural idea for approximating a function f by wavelets is to retain in 
[link] the NV largest contributions in the norm in which we plan to measure 
the error. In the case where this norm is L?, this is given by 

Equation: 


Avf:= > dyn, 


ACE p(f) 


where E’y.» (f) is the set of indices of the N largest || d, 7 ||». This set 
depends on the function f, making this approximation process nonlinear. 
Other instances of nonlinear approximation are discussed in [link]. 


An important result established in [link] states that 

|| f-Awf |lzp ~ N~7/“ is achieved for functions f € Big Where 

1/q = 1/p+r/d. Note that this relation between p and q corresponds to a 
critical case of the Sobolev embedding of Bj , into L?. In particular, Bj, is 


not contained in B; ,, for any € > 0, so that no decay rate can be achieved 
by a linear approximation process for all the functions f in the space BG, 


. (For some functions in By ,, which happen to also lie in spaces for which 


an independent linear approximation theorem can be written, it is of course 
possible to get a linear approximation rate; the point here is that this is 
possible only via such additional information.) 


Note also that for large values of r, the parameter gq given by 

1/q =1/p +r/d is smaller than 1. In such a situation the space Bé , is not 
a Banach space any more and is only a quasi-norm (it fails to satisfy the 
triangle inequality || 2+ y ||<|| x || + |] y ||). However, this space is still 
contained in L* (by a Sobolev-type embedding) and its characterization by 
means of wavelets coefficients according to still holds. Letting g go to zero 
as r goes to infinity allows the presence of singularities in the functions of 


Bog even when r is large: for example, a function which is piecewise @” 
on an interval except at a finite number of isolated points of discontinuities 
belongs to all Bi, for g < 1/s andr < n. This is a particular instance 
where a non-linear approximation process will perform substantially better 
than a linear projection. 


